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Concerns: 

Many play-back programs today don't even have a zoom option. To this extent, mode "b" 
may not be needed. 

Mode c could be implemented today with 16bit/pcl RGB (555) in s/w and the only 
improvement we provide is 24bii/pcl capability and h/w color conversion (some level of 
accelleration). So mode "c" may not be needed as a special h/w. 

If this is the case, maybe we do not need to do anything in h/w for Cinepak ! 

One idea: should we run 24bit/pcl MS windows stored in 4:2:2 (YO UOl Yl UOl) for- 
mat This will allow us to run 24bii/pcl MS Windows and use 16bit/pel memory space 
wjth no loss of qualm'. The windows dnvcr could compress the data and the h/w could 
decompress it. 
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4.4 Nordic-IM Motion Video Architecture 

Sasha EgUt, Rakesh Bindlish. Vlad Bril and Dave Keene are important contribu. 
tors to the Motion Video Architecture definition. 

4.4.0 The Problems to Solve & Generic Solutions 

Nordic. IM IS supposed to suppon CDROM plav-back and live-video under Microsoft's 
^ ideo lor Windows. With aJi of today s VGA Compatible Graphics Controllers, the plav- 
oacK picture pixel depth has to be the same as the surrownding MS Windows pixel depth 
b otncr words, we have to run MS Windows m a 24bit/pel mode in order to displav 24bit/ 
pel in the play-bacic window 

The only way we can run today live video is from a Video Pon (= Feature Connector). In 
this case we 11 use an overlay or a color key to define the live video window. 
Due to CDROM player, s/w interface complexity. CPU bus and Video Memorv limita- 
tions. only small clips at 15fps or less can be playd-back today. So todav we need a lot of 
Video Memory to run small clips in slow mouon at low rezolution. Nordic- IM will try to 
ui: less Video Memory, increase the dips size, their resolution and speed 

Cirrus Confldeotial 

.Nordic-IM is supposed to support: Business loformatioo 

■ accellerated play-back for all popular CDROM compression standards. espcciaUy 
Cinepak and Indeo 

live video from a PCMCIA card in a system with a standard PCMCIA host adapter 
for a Mulumedia-Ready Notebook Computer" 

.nm'rf m"^? from a Feanire Connector, preferably VESA Advanced Feature Connector 
compauble. for a Mulumedia Notebook Computer with diiea NTSC input (fuU mother- 
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board soluuoni. 

Whni wtil N'oHir>1M hPtng tn thg V1d#n pimp- 

A. Nordic- IM will break the dependency between the pixel depth of MS Windows and the 
pixel depth of the live-video / play-back window. By doing so, Nordic-IM will be able to 
run 24bit/pel LV/PB while ninmng MS Windows in 8bit/pel or 4bii/pel (even planar). 
This will lead to high qualir>' iivc-video and play-bacL while minimizing Video Memon- 
requirements. 

B. Nordic- IM will funher reduce Video Memory requirements as well as Video Memor>' 
. Bandwidth requirements by storing dau m compressed form: 4:2:2 YUV (16bii/pcl). 4: 1; 1 

"rT.^- (I2bii>pel) or Sashapak YUV f2.6bit/pcl) 

C. Nordic- IM will define one architecture and work-frame to run both play-back and live- 
video m a unitary way for both s/w and h/w. 

D. Nordic- IM will suppon up to two active LV/PB windows at the same time. 

E. By providing h/w YUV->RGB conversion and 1:2 zoom Nordic- IM will accellerate ' 
playback for most standards, but mostly for standards that allow us access to their decom- 
pressor like Cinepack (for whose decompressor we have a licence). 

Nordic- IM will not provide Cinepak specific accelleration (custom BLT). 

Qn the I.iVf Video from Feanirg Cnnn^aor inr V1di>o Pnrt^ 
Due to pin-out hmiutions, the VAFC implementauon has to be limined to 8 pins of data 
requinng externa] muxing of 16bit data to Nordic. Further, the VAPC solution will be 
restncied to 5428 r\'pc suppon: overlay and color key (no memory video pen). The only 
additions to the 5428 suppon will be the internal YUV-> RGB convener able to accept' 
sequenuaJ 4:2:2 YUV (I6bit/pel in avarage: YO.U.Yl.V) and display it as a 24bit/pel RGB 
in the overlay/color-key window. We may also suppon honzontal 1:2 zoom with avarag- 
inc Nordic- IM will be back-wards compatible to 5428 and it will suppon also 16bit 5-5- 
5 RGB Sierra and 5-6-5 RGB XGA pixel formats. As m 5428. live video from the Feature 
Coonector can be executed only from mode 5F (640x480 256 colors). 

In the following we will refer mostly lo the other two modes of opcrtation: play-back and 
live video from a PCMCIA card, which we'll call compressed live video, because due to 
PCMCIA bus bandwidth hmiutions. we assume that video dau received by Nordic is 
compressed with Sashapak (see Sashapak deiailes further m this spec). Please note that 
due to Its huge advanuges, it makes sense to use Sashapak as a mother-board solution too. 
The main reason we continue to suppon the Feature Connector based live video is the 
availability of dnvcrs for 5428 which will give Nordic an early stan in the live video 
arena 

Cirrus Confidential CL 99792 

Mdeo Memor. Ri>nd,wiHth rnnc^rnjn,^ Information 
Please note that, even with a 32bii wide Video Memory, there are severe memory band- 
width Imutauons when ninning 16bit/pel and 24bit/pcl graphics modes. 

Assumming that Nordic- IM does 8 CRT fetches in a row and 1 CPU cycle, for a CRT or 
TFT panel, here are the minimum frequency requirements for memory clock ftequency at 
different rezolutions and pixel depths: 
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- 24bit/pe!: 

R+7P+R=12m+I4m=26m with 1 CPU cycle per CRT FIFO fiU fetches dau for 

32B/3B=10pixels 
R+7P = 6m+14m = 20m with no CPU cycle during non-display umc 
min mclk freq = 65MH2 / 50MHz @ 640x480 -> Nordic- IM upper linoit at 5V CVDD 

= 104MH2 / 80MH2 @ 800x600 -> too high 

= 169MH2 / I33MH2 @ 1024x768 6OH2 -> too high 

R-k7P+R= 1 :m+ 1 4m=26m / R+7P = 20m fetches data for 32B/2B= 1 6pixels 
nun mclk freq = 4O.6MH2 / 36MH2 @ 640x480 •> OK even at 3 V 

= 65MH2/50MH2 © 800x600 -> Nordic- IM upper limit at 5 V CVDD 

= 105MH2 / 83MH2 @ 1024x768 6OH2 -> too high 

R+7PfR=12ni-Kl4m=26m / R+7P=20m fetches data for 32B/1.5B=21pixels 
mm mclk freq = 30.9MH2 / 23MH2 @ 640x480 -> OK even at 3V 

= 49.5MH2 / 38MH2 @ 800x600 -> OK even at 3V 

= 80.4MH2 / 64MH2 @ 1024x768 6OH2 -> too high 

8bit/pH: 

R+7P^R=12m+14m=26m fetches data for 32B/lB=32pixels 
mm mclk freq = 20.3MH2 @ 640x480 -> OK even at 3V 

= 40.6MHz © 800x600 ->0Kevenat3V 

= 52.8MH2 @ 1024x768 6OH2 -> OK at 5V 

Wc may cnnciurif that Nordic- IM will be able to run 24bit/pcl only at 640x480 rczolu- 
iion. 16bit/pei up to 800x600. 12bit/pei up to 800x600 and 8bit/pcrup to 1024x768 rtzolu- 
non These results apply only to CRT or TFT and single scan STN panels. 
Please note that for dual scan STN panels the memory- requu-ements increase significantly. 

These severe memor>- bandwidth limitauons lead us to anempi to mininuzc video memory' 
irafn: If we store Cinepak data in 4:2:Z with an avarage of 16bit/pel, independent of 
Cincpak window size. Nordic-IM will not be able to run Cinepak above 800x600. 
Any anempi to execute venicaJ zoom wjth interpolation, even with two points intcrpoia- 
iion will funher aggravate this memory band- width bottleneck. The next step should be 
IOOMH2 SDRAM-s with a large CRT FIFO (32x32) or 64bit wide memory data bus. 
These considerations apply to any playback compression standard that stores data in 
video- memory as 16bii/pcl in avarage. The key to a successful compression standard 
would be one that does decompresssion on the CRT memory read and stores dau in mem- 
ory as 8bii/pel or less, m avarage. 

As we store Uve video at 2.6bit/pel and fetch it as ifit was Sbit/pel with Sashapak, 
Nordic- IM should be able to run live video even at 1024x768. 

If we defined a new CDROM play-back standard based on Sashapak, then we could run 
even 102,4x768 wuh 24bii/pel accuracy and keep 11 memory as an Sbit/pel. Keith and 
Ken are acnially working on iu with Sasha*s help. 

4.4.1 OnSashapak Cirrus Confidential CL 99793 
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Sashapak is a highly assymc'Jic. lossy "Block Truncation' compression aigonthm opu- 
mized for visually equivalent image processing. 

Data IS procccsscd as Y,U.V one b>ie each. U and V arc sub-sampicd. characienzing one 8 
by 8 pixel array, while Y is characienzing a 4x4 pixel aray. Actually one of two values is 
assigned lo each pixel inside the 4x4 (for Y) and 8x8 (for U and V). 
At compression time, the compression chip determines a threshold and two values V&L 
for each group of sixteen (4x4) pixels. This way all pixels above threshold will be 
assigned the value U. all pixels below threshold will be assigned the value L. 





31 Ibvte ibvxe 2bytes 0 


4 4 YO 
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L 1 BITMAP 
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Yl 1 Yl 
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i 64pixels are descnbed bv i ■ 
' 6x4B=24B=192bus 
=> 3bitypei 

Using 6bits for U & L V 
the compression will be 
2.6bit/pel. 



BITMAP 



BITMAP 



V 



At decompression, the bitmap will control a mux between the U and L values. This way 
the decompression is su'aightfonA-ard. 

The main drawback of this approach is that a BITMAP contains Y data from 4 scan lines 
and LW data from 8 scan lines. WTien data is read from memory to be displayed only data 
from one scan Ime is used. Similarly the U/L values apply to several scan-lines and the 
same value will be read in each scan hne. The same data will be read again and agam m 
each scan line raising the actual memors* bandwidth requirements to an equivalent of 
16bii/pel map. 

In order to overcome this problem and reduce memory bandwidth requirements. Sasha 
proposed a scan line oriented, segregated mode of data organization. This would 
require the Sashapak compression chip to wnie compressed data m a specific way puting 
the strain on the compresion chip address generator. The basic pnnciples of the new orga- 
nizations are: 

i Data is organised m the MV Window m chunks of 32 sequential pixels. 

aiFor 8bit U/L resolution, as one Y covers 4 pixels, 8 U/L sequential values arc needed, 

16biis each -> 8xl6/32=4W (8xl2/32=3W for 6bii res. U/L) (where W is a 32bii word). 

b) U and V U/L data is packed together m the same word (16bits for U U/L and 16 bits for 
U/L •> total 32bits= 1 W) and as one pair of U and V applies to Spixels, 4 such values 

are needed for 32 sequential pixels -> 4x32a4W. (4x1 2x2/32=3 W for 6bii res. U/L) 

c ) The mask dau is also scan-line onented: all 32bits of Y mask of sequential 32pixels arc 
placed m one 32bii word and due to sub-sampling on U and V, all 32bits of U and V mask 
of sequenual 32pixels are placed in one 32bit word. So in 2W data for 32 sequential pixels 
on one scan line is packed. -> 2W (the same for 6bii resolution for U/L) 
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d) For 640x480 wmdow size, even at 8bii U/L resolution, data for 8 scan-lines nts in one 
DRAM page (symemc DRaM-s assumed): 320WY+80WU+80WV=480W < 512W page 



U/L for Y 



^fvwl 

STAR? 

n-NfVU'.Offtei 



480W for one 8x640 pueis block fiu in one page 



U/L for U.V 



Y bianaps 



UVbianaps 



1 I60W SLA*AOh sow SLA-^FOh 160W SLA*l90h SOW 

Where Si i$ scan-iine number i inside the block - ^'^ ^^-^ — ^^-^ 



8Bii per U/L 
resoluuon. 

Dita Grouped 
per Sc4n Unes 



D The key to memory bandwidth opumizauon is the fact the the compression chip will 
organize data sequenually over 32 pixels instead of 8. This will be done for the mask bits 
which will be organized sequenually by scan line and for the U/L dau. This way a 32bit 
word of Mask data contains only informauon for the current scan line and no extra mem- 
ory fetches are required. The main reason we segregate U/L for Y and U/V is the fact that 
we want to use 6bii U/L, In this case it is easier to identify the proper U/L info chained 
within 32bit words if the words are sequenual and we have a fix relationship between 
ihcu- address and the 6bit U/L quantiues. 

g) If we calculate now the amount of data we need to fetch to displav 32 sequential pixels: 

• for 8bit per U/L: 4W (W/l) ^ 4W fUV U/L) + 1 W (YM) + 1 W (UVM)=I0W=40B 

-> 40B/32pixels=320bit/32pixelsslObii/pel to fetch from memory 

- for 6bit per U/L: 3W n^fl) ^ 3W (UV U/L) ^ I W (YM) ^ 1 W (UVM)= 8W=32B 

-> 32B/32pLxels = 8bit/pixe] 
This IS a vcr>- good data fetch ratio, much bcncr than the 16bit/pel we'd get without the 
opumizauon. 

g t V.'hen reading dau from the Mouon Video Window the conaoUer will generate the fol- 
lowing sequence of addresses, all of them m the same DRAM page (8bit per U/L): 

- fetch the YU/L for the first 32 pixels on scan-lmc n at addresses; 
MW.'.Stan+n-MV'U'^offsei, +1. +2, +3 

- fetch the UV U/L for the hrsi 32 pixels on scan-line n at address: 
MVV,'_Stan-»"n»MVU-^offsei-^AOh. -t-l. -t.2. +3 

• fetch the Y BiiMap for the nrsi 22 pixels on scan-line n at address: 
MVU'^Stan-i-n-MVU-^offsei-cFOh 

- fetch the UV BitMap for the first 32 pixels on scan-lme n at address: 
M\'V,•_Sla^*n•MV^^'.offset+ 1 90h 

• fetch the YU/L for the first 32 pixels on scan-line n at addresses- 
MV\^'_Stan-f-n'MVU'.offsei-^, -^5. -♦^6. -^7 

• fetch the UV U/L for the first 32 pixels on scan-lme n at address: 
MV^^•.Sta^+n•MW•_offseI-^A0h44. -^5. -»^. +7 

- fetch the Y BitMap for the ftrsi 32 puels on scan-line n at address- 
MVV.-.Sian^n-MVS\'_offsci+FOh-Hl 

• fetch the UV BitMap for the first 32 pixels on scan-Une n at address 
M VU'.Sian+n*MVU'_offsei-^ 1 90h-»- 1 

• now the MV\^* FIFO is full. 

- chunks of ten 32bii words will be proccessed for every 32pixels displaved 

- the MVW FIFO gets empty after the first 10 words being read for decompression and 

display. ^ 

Please note that all data for every 8 scanlines starting from the top of the MVW is in the 
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same ORAM page. 

Because we have to fetch the NfVU' Data before we stan displaying it, and because at that 
time the CRT FIFO docs not empn- as fast as it is needed (unless MS Windows is runiung 
at the same pixel depth as the MV Window), it is necessary to have a separate FIFO for the 
MVW or at least half the FIFO (at least lOW for 8bit per U/L and at least 8W for 6biis per 

U/LV 

h) \^lien we run 6bit per U/L, because the Video Memory band- width requirements are as 
if we were running 8bit/pei. we could do vertical zoom with avaragmg. But there should 
not be a need for zoom with Live Video because there is enough CPU and memon* band- 
width to run 640x480 windows even when MS Windows is run as 1024x768 4 or 8bit/'pcl. 

Conclusion: With Sashapak we can get data organized in memory such that the memor>' 
bandwidth is as for lObit/pel (8bit U/L) or 8bit/pel (6bit U/L) pixel depth. The actual 
memor> area will be close to 3bit/pel or 2.6bit/pel depending on the resolution of U/L val- 
ues - 8 or 6bits per value. 

Please note that the memor>' area will be slightly larger due to the fact that we use only 
480 words in a page of 5 12. 

4.4.2 10 RGB Conversion Algorithm 

The ideaJ YVV to RGB transformauon is: 
R=:Y* 1.37V 
B=Y^1 -3U 
G=y-0.699V.0.336U 

After denning an objective way of measunng color error. Sasha came up with the follow- 
ing Conversion algorithm: 
R=V-L375V=Y+l 3/8 V 
B=Y-!."5U=Y-hl 3/4U 
G=Y.0.375U-0.75V= Y-f3/8U-^3/4Vi 

This aieonthm can be implemented with 8 9bit adders and it should support excess 128 or 
two s compiemeni LW formats (U.V may be negative while Y is always positive). 
This aleonihm will be used with Live Video. 

For Cincpak. the VUV->RGB convener will be reconfigured to the Cinepak YUV->RGB 
conversion rule: 



4.4.2 Motion Mdeo Architecture Functional Blocks 

Instead of treating play-back and live-video as two separate modules, we'll isolate several 
generic functions to be used by both: 



R=:\*Y 

B=U*Y 
G=^'A7:.U/4 
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- Display Window Gcnerauon Block: 

allows s/w to define one or two play-back or live video window(s). 

The MV Window is defined m memory cycles relative to the start of line m horizontal 
and frame in verucal dorecuon. Horizontally the unit of measure is different outside rela- 
tive to the inside of the wmdow: the horizontal window stan coordinate is expressed in 
memory cycles for the surrounding pixel depth (MS Windows pixel depth, normally 4 or & 
bit/pel), while the width of the MV^* is expressed in memory cycles for the MV\^' pixel 
depth (8bii RGB. 16bitRGB. 422 YL^ spaciai, 422 YUV linear,'411 YUV Imear. 
Sashapak). 

- XS = MV^' Honzontal Stan Coordinate (in surrounding 

pel depth memory cycles) 
The honzontal position is programmed with 8 pixel resolution 
(0.8. 1 6.... pixels stanmg from the left side of the screen) 
XS register CR34f7:0] •> 8 bits 
(up to IK pels in mcrements of 8 pels) 
To get an early warning, we will requue XS to be programmed 
8 pixels less than the actual position: 0 is zero. 1 is 16pels, 2 is 
24 pels.... 

- XW = MV>\' Honzontal Width ( MVW pel depth memorv cvcles) 

XW register CR35 [7:0] -> 8 bits 
(up to 1 K pels in increments of 8 pels) 

To get an early waxmng. wc will require XW to be programmed 
8 pixels less than the actual width: 0 is zero. 1 is 16pels. 2 is 
24 pels.... width. 

• YS = Venical MVW Stan (m true scan-lines not affected by 

scan-line doubling or panel vertical expansion) 
10 bus m CR36( 1:0) (msb-s) and CR37[7:0) (Isb-s). 

• YL = Venicai MVW End 

(aJI bus are programmed, in true scan lines) 

10 bits m CR36(3.2) (msb-s) and CR38[7:0) (Isb-s). 

- SAdOfr Sunoundmg Address Offset (a number to be added every 

line to the sunoundmg CRT Address Counter value to allow it to 
jump over the MVW without counting through it. This allows calculating 
the suroundmg restan address. ) This number depends on the sum)unding 
mode resolution. Assuming a maximum line of 1024 pels, in increments 
of 4 pels per address (8bits/pel). 256 addresses is enough -> 8bits 
8bits m CR39f7:0] 

• WMAdS = MVW Memory Address Stan m increments of 

16KB = 4KW (a phisical address 00000:3FFFF for 1MB or 
00000:7FFFF for 2MB Video Memory). 
7bits m CR3A{6:0] 

• WMAdOf = MVW Memory Address Offset (A number to be added to 

the current MVW Stan Address to get the next MVW start Address). 
Having this s/w model allows panning through a large image for the 

'^^^ ^^al image stored in memory may be as large as 1 K pixels 
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at 16bii per pixel (2 per word) •> 9bits. 

9bits •> m CR36(4] (msb) and CR3Bf7:0) (Isb). 
Because the CRT Address Counter counts surrounding memory cycles, during the MV^' 
display it would count a wrong number corresponding to the MVW pixel depth. To avoid 
this wrong count, the CRT Address Counter is stopped w hile MW Hiepi^v^H anH 
loaded with the vaii "* '"^nr^rnnriing tn rh^ NfYft' restan of the surrounding 
dTsplay. As this address value changes every line, an ofifsct is specified and will ba pro- 
grammed by the MS Windows driver depending on the MVW size and pixel format. 
The honzontai size of the wmdow is controlled by a different counter counung to XW. 
During the MVU* display the adddress will be generated by the same CRT Address 
Counter which will be loaded wiih a MVW Memory Address Stan (WMAdS). 

- XW8P = MV^* Horizonul Width in 8 pixel units. Defines the size of 
the window m 8 pixel units. It is used to terminate the window horizontally. It may require 
to program the value minus one or rwo. To be Defined Later Register CR3D(6:0] will 
contain this value. . 

Every scan-line ^ - 

M VU Scao-LiDc Sun Address s Previous ScaD-Line MVW Sun Address ^ WMAdOf 

Scan-line doubling for "zoom" should be taken into account when designing the 
M\^' Architecture: on the address generation block. 

-Ofr •screen M\' Memor> Addressing and Access Control. This includes data type tag 
generaiion based on M\' memory Address and the circuitry placing the tags in the CRT- 
FIFO This block has provisions for scan line replication by repeating the MV address 
generated on the previous scan line of the MV window (only). 

As Cmepak needs 41:1 rectangular format the MV Memory Address Counter needs to 
count in a non sequeniia] way: 

YOSn YlSn Y:S(n-^n Y3Sfn+n U V 
implies an address counter thai can skip over two numbers, or maybe a second address 
counter that suns counting from 2 instead of zero. 

- One tag bit is generated based on CRT Address and is 1 if the data in the CRT 
FIFO is from the MWV, other-wise is 0. This tag bit, called the steering bit will be 
dcla> cd through the enure data path and end up controlling the final video data mux just 
before the DAC. 

Other ug bits called "data-type" Ug biu encode the type of 32bii word in a given 
data format and are used by MV\\' Decoder/Senaliser to steer CRT-FIFO dau at CRT- 
FIFO read. 

For instance, in 4: 1 ; 1 Imear data format, dau is stored in memory and in the CRT-FIFO 
asY0Yiy:Y3 U03V03Y4Y5 Y6Y7 U47V47. 3 groups of 32biis. Two "daia-rypc tag 
bus will mark the three types of 32bii words so that sieenng logic knows where to place 
the three words in the data scnabser. 

Similarly Sashapak will need 3 "data-type" tag biu to encode 8 32bit words (for 6bit per 
U/L) or 4 ■ dau-rype" tag bits to encode 10 32 bit words (for 8 bits per U/L). 

16bii RGB 5:6:5 and 5:5:5 and 8blt RGB 3:3:2 can cither use the standard VGA daU 
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path, which in 5428 was extended to 16bit wide (used for 16bit/pel lkx768 interlaced i or 
the new dau path, if a phisicaily new dau path wiU be actuaUy created. 

- MV Dau Path . This is area wise the largest piece. It consists of a new I6bit wide dau- 
paih with the same delay as the VGA data path, that takes MV dau from the MV prefetch 
cache and the CRT FIFO, treats it appropnately depcndiag on the MV dau format 
encoded in the MV ugs and convens u to 24 bit YUV first and 24bit RGB second. Hori- 
zontal zoom with avaragmg (or maybe 5 levels of interpolation) is in this block too. 

• Larger (26 or 24 suges) CRT-FIFO. Variable CRT-FIFO threshold and its control 

Because the MS Windows pixel depth and MW^' pixel depth don't matth, it is necessary 
to reserve CRT-FIFO space to fill in enough high pixel depth dau before the MV^' dis- 
play starts. In Sashapak this means 10 or 8W (for 8 or 6bits per U/L respecuvcly). 
This funcuon can be implemented as a dinamic threshold size modification of the CRT- 
FIFO. If the CRT-FIFO has 24 suges mstead of 16 but only 16 stages are used before the 
MV)^* but it is switched to 24 when MVW fetches start, there will be 8 more stages to fill 
at that ume ensunng more prefetched dau m the CRT-FIFO at the beginning of each 
MVW scan-lme. 

In normal operation the threshold is 8 (or 6 ). 

Here is the sequence of events that follow the detection of MVU' surt: 

1. Drop CRT-FIFO threshold to 1 to get immediat service 

& make 10 (or 8) more stages available in the CRT-FIFO. 

2. Start fetching ^^V^\ data till CRT-FIFO is full. 
(BLT in progress will increase latency) 

3. Increase threshold to 10. 

4. Proceed as such till end MVW. 

5. Load the CRT Address Counter with 

its last contents ^ SAdOf 
(where SAdOf = Surrounding Address Offset) 

7. Continue fetching based on the new address 

(start with random cycle). CRT-FIFO threshold remains the same 
• at least 10 or 8. CRT-FIFO size is still 26 or 24. 

8. At the end of line, upon flushing the CRT-FIFO before prefetch, 
decrease CRT-FIFO size back to 16 keeping the threshold the same. 

9. Go back to #1 for the next scan-line. 

This sequence is applied if MV\\ pixel depth is higher than surrounding pixel depth. 
If Nmv pixel depth is lower than surrounding pixel depth, then the action described 
at #1 above ukes place at the end of MVV^\ instead of the beginning. In other words, 
FIFO depth extension takes place when a swiuh from low to high pixel depth occurs. 
If NfX'W pixel depth is the same as the surrounding, only the address is switched. In 
this case the CRT FIFO depth and the threshold remain the same. 



- Steenng logic decode the tags comming out of the special addition to the CRT-FIFO and 
the pre-feich buffer and controls the decompression, formatting and senalization. 
(they icU the formaner what dau is Y, U or V). 
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- Wha: about ihc video scnalizcr load and the CRT FIFO read signal? What hapcns to 
them when in MVW? They are one signal today. 

WHEN the data path switched to display MVW data, what hapcns with the VGA Video 
Data Path is don*i care as we do not display that data, except for the h/w cursor anf the h/ 
w icon thai do not go through the standard VGA senalizcr. So we*ll probably stop the 
VGA dau path untill the point h/w cursor and h/w icon are combined into it. to save 
power, as we will stop the MVW dau path when not in use, for the same reason. 
So. the Video Serializer Load may be stopped while MVW data is displayed, but ibe 
CRT FIFO read will be going on. with a frequency and shape depending on the data 
format loaded in the CRT FIFO for display. 

In RGB 3:3:2 8bii/pel direct color mode CRT-FIFO read will be generated every 4 vclks. 
In standard RGB 5:5:5 or 5:6:5 16bit/pel modes CRT-FIFO read will be generated every 

two vclks. 

In YL'V* 4::;2 24bit/pel fYO U YI V on one scan line) the CRT-FIFO read will be gener- 
ated also cver>' two vclks. 

IN Sashapak 10 (for 8bii per U/L) or 8 (for 6bit per U/L) CRT-FIFO read pulses will be 
generated ever>' 32 vclks. 

■ The MVW' Address Counter, loaded at the beginning of each MVW scan-line with a start 
address calculated based on the Stan MVU' Address and the MVW Address Offset, will 
count at format dependent rate for as long as the CRT-FIFO is not fiill. Because the CRT- 
FIFO will be emptied faster m the MVU' (m general the pixel depth will be higher m the 
MVV.'i there will be requests for more memor>' cycles when displaying in the MVW. 

• if either h/w cursor or h/w icon are on. they should be displayed even if the direct data 
path IS used. In this case both video data pathes will clock and the steer tag will point to 
mc \'G A data path when either h/w cursor or h/w icon or both are displayed, even on top 
o: a Nt\' window. Please note that neither the h/w cursor, nor the h/w icon' data go through 
the CRT FIFO or the VGA Dau path except for the final pixel address block and the 
RA.MDAC RAM though they have a special path m the RAM. So we could stop most 
of VGA data path (including the internal palerie) but not all of it even if we are in 16bit/pel 
mode iihe new one that goes through a separate 16bit data path). 

- If uc are in a 16bit/pel mode with no h/w cursor or h/w icon, or in a 640x480 MW^' 
mode filling the screen, we can stop the VGA dau path to save power 

- The off-screen MVW memory will be a programable sian memory array normally 
placed towards the end of the memor>'. but before h/w cursor, h/w icon and the half frame 
buf^e.^ even the color one. The sun of the MVW memory will be programable in incre- 
ments of 4KU' (16KB) as a physical address -> Tbits to program. 

CR3B|6:0) is the MVW Memory Array SUrt Address 
2MB configur»Uon will support enough memory to support: 

- one 640x480 3bit/pel window or up to two 320x240 3bit/pcl (Sashapak) -> 32KW 

- one 640x480 16bit/pel window or two 320x240 16bit/pcl windows 
n53.6KW=614.4kB out of 25610^' or 512KW available depending on the memory con- 
ngurauonj . 
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- all of the above at the same umc up to a total of two windows though. 

1MB configuration will support: 
. one 640x480 3bit/pc] Sashapak window or two 320x240 Sashapak windows or 
. two 320x240 16bii/pel windows. 

Please note that about 24FO^' are needed for 800x600 DS Color STN HFB, the h/w cur- 
sors and h/w icons while about 18ICW' are needed for 640x480 DS Color STN HFB and 
that 

- 640x480 4bit/pcl requires 38.4kW 

- 800x600 4bit/pci requu-es 601C^' 

- 1024x768 4bit/pcl requires 98.3KW 

- 640x480 8bii/pel requucs 76.8KW 
• 800x600 8bii/pcl requires 120IOV' 

- 1024x768 Sbiupcl requires 196.608ICS^* 

Video Motion Formats supported are: 

- 8bit RGB 3:3:2 going through the paJette (RGB 3:3:2) 

• 16bit RGB (5:5:5 Sierra and 5:6:5 XGA) not going through the paJene -> this is a 16bit/ 
peJ that does not require double dotclock !! 

- 4:1:1 array converted to 4.2:: YO Yl Y2 Y3 U V •> YOUYl V Y2UY3V for Cinepak 

(with Y2Y3 for the next scan lino 

- 4:2:2 linear YOUYl V from TV Decoder 

• Sashapak format (we'll suppon only 6bit/pcl) 

- forSbu per U/L: 

4W (YL'/L) * 4W a'V U/L) ^ I W fYNl) I W {L^)=10W=40B 

"> 40B/32pixels=320bit/32pixels=10bii/pe] to fetch from memon* 

- for6bit per U/L; 

3W (YV/L) * 3U' ru\' U/L) ^ I W (YM) - 1 W (UVM)= 8W=32B 
"> 32B/32pueis = 8bii/puel 

CR3C[3:0] will encode ihc pixel formal for the hrst motion video window data: 
Oh = 0000 = Sbit RGB 3:3.2 going through the palette 
lh = 0001 = 16bii RGB Sierra (5:5:5) 
2h = 0010 = 16bii RGB XGA (5:6:5) 
3h = 0011 =4 2:2 ^X^* YOUYIV 
4h = 0100 = 4: 1 : 1 YUV Imear YOYl Y2Y3UV 
5h = 0l01 =4:1:1 YUV array Y0Y1Y2Y3L^^ but Y2Y3 arc m next 
scan line 

6h = 0101 = Sashapak 6biis for U/L 

7h = 01 10 = Sashapak 8bits for U/L 

8h:Fh = 0ni:lin = reserved 
CR3C(4] s Enable Motion Video Window dmis Confidential 

CR3Cf5] = Enable Live Video in Full Screen Business Information 

CR3C[7) s MVU' honzontal zoom (doubling j 

CR3C(6) = MV^' vcrucal zoom (doubling) CL 99801 

Note: Wc will not suppon 4:1:1 linear from TV decoder, for design simplicity. 
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Memory data formats: 

- 8bii and 16bii RGB, as m 5428. . 

-4:1:1 Cincpak convened to 4:2:2 by writing a 4:2:2 Code-Book - . - 

first scan line -> YOUY 1 V -> One 32bit Word 

second scan line m memon -> Y2UY3V -> One 32bit Word 

- 4:2:2 linear will be mapped in mcmon* as follows: 

finiscanhnc YOUY IV 

first scan bne Y2UY3V 

coosecuuve data in the same scan line. 

The tags thai accompany the motion video data through the CRT-FIFO mark both the data 
format and the type of data mside the format f U/L for Y or U,V or mask for Y or U.V in 
Sashapak . YO. Yl.U or V in 4:2:2 ). 

Double Buffering for MVW' Video Memory Data 

In order to get a high quaJin- Live Video full frames should be displayed at all times. This 
assumes that wnung the video buffer and displaymg it arc in sync, which is normally not 
the case. 

To solve this problem and provide a simple interface between MVA h/w and the driver. 
Nordic will suppon a double buffer approach. 

■AddressinP with Sa^hanarl- 

Sasnapack stores data tor eight scan-lines m one memory page (works only with synchro- 
nous DRAM-s). But due to L'.V sub-sampling diferent dau types are not read from mem- 
ory uniformly. 

Qr y y/L the first four scan-lines read at offset 0 in the page, but the second four scan- 
lines read ai offset 50H m the page. 

Qn I'A' y^ wc read the same data for each scan-line. So we repeat reading the same data 
ai ail limes, for eight scan-hnes Page addresses to read are AO:EF If the scan-line is 
shoner it will end sooner. 

Qn y Map the data should be sequential, scan-line onenied: first pixels 0 to 639 on the 
first scan line, than pixels 0 to 639 on the second scan line and so on till the 8-th scan hne. 
If the lines have less than 640 pixels. Sasha wants them cropped for the first 4 scan lines, 
and then siarung again from the half for the next four scan-lines. This is m sync with Y U/ 
L where the last four scan-lines sian from mid. 

Pn I' A' Map* because of the vertical subsampling. the same dau is read for two scan 
lines, so there arc four scan-hnes worth of dau but each scan-line is read for two consec- 
utive scan-hnes. Even if the scan-lme is shorter, there will be a gap cvery-scan-line: there 
arc fix page addresses for each scan-linc up to 640 pixels wide. 
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Memory data formats: 

• 8bit and 16bit RGB. as in 5428. 

- 4: 1 : 1 Cincpak convened lo 4:2:2 by writing a 4:2:2 Code-Book 
first scan line -> YOUY I V -> One 32bii Word 

second scan line in memory- -> Y2UY3V -> One 32bit Word 

- 4:2:2 Iinear will be mapped in mcmor\' as follows: 

first scan line YOUY IV 

firsi scan line Y2UY3V 

consecutive data in the same scan line. 

The tags that accompany the mouon video dau through the CRT-FIFO mark both the dau . 
formal and the r>'pe of data inside the format (U/L for Y or U.V or mask for Y or U,V in 
Sashapak. YO. Y1,U or V m 4:2::;. 

Double Buffenng for MVU' Video Memory Dau 

In order to get a high quaJity Live Video full frames should be displayed at all times. This 
assumes that wnung the video buffer and displaying it are m sync, which is normally not 

the case. 

To solve this problem and provide a simple interface between MVA h/w and the dnver. 
Nordic will suppon a double buffer approach. 

Addressing uith Sa^hapark- 

Sashapack stores data for eight scan-lines m one memory page (works only with synchro- 
nous DRAM-s). But due to LW suD-sampiing difereni data types arc not read from mem- 

orv- uniformly. 

V the first four scan-lines read at offset 0 m the page, but the second four scan- 
lines read at offset 50H m the page. 

Qn I' . V we read the same data for each scan-line. So we repeat reading the same data 
at all limes, for eight scan-lmes. Page addresses to read are AO:EF. If the scan-line is 
shone: it will end sooner. 

V M a p the data should be sequential, scan-lme onented: first pixels 0 to 639 on the 
first scan line, than pixels 0 to 639 on the second scan line and so on till the 8-ih scan line. 
If the lines have less than 640 pixels. Sasha wants them cropped for the first 4 scan lines, 
and then starting again from the half for the next four scan-lines. This is in sync with Y U/ 
L where the last four scan-lines stan from mid. 

Qn V . V Map . because of the venical subsamplmg. the same data is read for two scan 
Imes. so there are four scan-lines wonh of dau but each scan-line is read for two consec- 
uuve scan-lines. Even if the scan-line is shoncr. there will be a gap cvcry-scan-Une: there 
are fix page addresses for each scan-lme up to 640 pixels wide. 
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Where: 



Full Screen in a given graphics mode 



YS 



xw 



YE 



Motion Video 
Window 
Display Position 



WAdOf 



XW8P 



-xs 



MVW Honzonial Sun Coordinate (in surrounding 

pel depth memorv' c>'cics i 

• XW = MVU' Honzonial Width ( MVW pel depth memory 
cycles) 

- VS = Vertical MV^^' Sian (in true scan-lines not affected by 

scan-line doubling or panel venical expansion) 

• YE = Venical MVW End 

(ail bus are programmed, in uue scan lines) 

• WAdOf s MV>\' Address Offset (a number to be added 

every line to the CRT Address Counter to allow ii to jump 
over the MVW without counung through it. 

- XWgP = MVS\' honzontal width expressed in 8 pixel units 

Please note that MVW honzonial width is defined twice in different units: 
XW defines it on the memory side in memory cycles 
XW8P defines it on the CRT side in 8 pixel units. 
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Video Memorj 
Data 



i CRT& NtVU Addr. Dec, 



I 



i 




T 
A 




CRT-FIFO 


T 


G 
S 






MVW-FIFO 



Sceer-tag 



VIDEO 
CONTROLLER 



Data in DifTerent 
Formats 



Sashapak 
and 4:2:2 
Decompr. 
& 

Serializer 



I 

0 
L 
Y 



I 



Data Format 



tags 



Upsampling 
Filtering 



PALETTE 




T 



I 



YUV.>RGB 



I 



We'll need to 
match the delay 
io the two data ' 
pathes. 



1 



16bit/pe) wlU go through the 
MVU data path in all cases. 



Videt 
▼ to 



Video Data 
to 

DAC and Panel 
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_____ Nordic - Register Definitions 
I Lfi Registers for Motion Vj^ieo Architecture 

5.1 CR34 . MVW XS Register 
Bit Definition 

[7:0] MVW Horizontal Start Coordinate XS (in surrounding pet depth memory cycles) 

The honzontai position is programmed with 8 pixel resolution (0.8.16.... pixels 
staning from the left siae of the screen) (up to 1K pels in increments of 8 pels). To 
get an eany warning, we will require XS to be programmed 8 pixels less than the 
actual position: 0 s zero. 1 s 16 pels. 2 s 24 pels. etc. 



5.2 CR35 • MVW Horizontal Width XW Register 
Bit Definition 



[7:0] MVW Honzontai Width XW ( MVW pel depth memory cycles) (up to IK pels m 

increments of 6 pels). To get an early warning, we will require XW to be pro- 
grammed 8 pixels less than the actual width: 0 = zero. 1 s 16 pels. 2 s 24 pels, 
etc. width. 



5.3 CR36 - Vertical MVW High Position Register 
Bit Definition 



Reserveo 



(6j Cineoak type YUV to RGB conversion. 

If this bit = 0. YUV to RGB conversion is done according to the standard algorithm 
^ If this bit s 1 . the YUV to RGB convers ion is done based on Cinepak algomm. 

;5: Excess 128 for YUV to RGB conversion. 

U and V are integer values expressed as two-th complement or excess 128. 

If this bit = 0. the YUV to RGB convener assumes that U and V are expressed in 

2-th complement format (as in Philips SAA715B and SAA9051 TV Decoders). 

If this bit = 1 . the YUV to RGB convener assumes that U and V are expressed in 
excess 128 fo nnat. 

!f] MVW Memory Address Offset (WMAdOf MSB) 

JTI] Vertical MVW End MSBs (see CR37) Cirrus ConrideDtial 

■ ^ Busioess Information 

:^:01 Vertical MVW Start MSBs (see CR38) 
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Nordic - Register Definitions 

5.4 CR37 * Vertical MVW Start Register 

Btt Deftnttion 

[7:0] Vertical MVW Start YS: (in true scan-iines rot affeaed by scan-line ooubling or 

panel vertical expansion) 10 bits in CR36[1:0] (msbs) and CR37[7:0] (Isbs). 
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Nordic - Register Definitions 

5.5 CR38 * Vertical MVW End YE Register 

BK Definition 

[7:0] Vertical MVW End YE: (all bits are programmed, tn true scan lines) 

10 bits in CR36(32) (msb-s) and CR38f7;0) (Isb-s). 



5.6 CR39 - Surrounding Address Offset Register 
Bit Definition 



[7:0] Surrounding Address Offset: SAdOf (a number to be added every line to the 

surrounding CRT Address Counter value to allow it to jump over the MVW without 
counting through it. This allows calculating the surounding restart address.) This 
number depends on the surrounding mode resolution. Assuming a maximum line 
of 1024 pels, in increments of 4 pels per address (8-bits/pel). 256 addresses is 
enough for eight bits 



5.7 CR3A - MVW Memory Address Start Register 
Bit Definition 



f5;0; MVW Memory Address Start: WMAdS in increments of 16KB = 4KW (a phisicat 

address 00000:3FFFF for 1MB or 00000:7FFFF for 2MB Video Memory). 
Note that on the CPU side, this Stan Address should be aligned at 16KB. 



5.8 CR3B - MVW Memory Address Offset Register 
Bit Definition 



r^ o; MVW Memory Address Offset WMAdOf (A number to be added to the cuneni 

MVW Stan Address to get the next MVW start Address). Having this s/w model 
allows panning through a large image tor the MVW. The actual image stored in 
memory may be as large as 2K pixels at 16 bits per pixel (two per word) •> 1 0bits. 

1 0bits o in CR36[5:41 (msb) and CR3B[7:0] (Isb). 

Cirrus Conndeotial 
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5.9 CR3C • MVW Pixel Format Register 
DefinKion 



u.igineenng Specification 
Nordic - Register Definitions 



Btt 



[6] 



[5] 



[4J 



MVW horizontal zoom (douDting) 



MVW vertiesi zoom (doubling) 



Enable Live Video in Full Screen 



Enable Motion Video Window 



[3:0] Encode format for the first Motion Video Window as well as full screen grapnics 

going through the MVA data path at lx dot-dock frequency: 
Oh s 0000 s 6 bit RGB 3:32 direct (not through the palette), going through MVA 
lh = 0001 s 16 bit RGB Sien-a (5:5:5) (at 1x dot-dock frequency) 
2h s 0010 s 16 bit RGB XGA (5:6:5) (at 1x dot-dock frequency) 
3h s 0011 = 4:2:2 YUV Y0UY1 V 
4h = 0100 = Reserved for 4:1 :1 YUV linear Y0Y1 Y2Y3UV 
5h = 0101 = Reserved for 4:1:1 YUV an^ay Y0Y1 Y2Y3UV but Y2Y3 are in next 
scan line 

6h s 0110 s Sashapak 6 bits for U/L 
7h = 0111 = Sashapak 6 bits for U/L 

8h= 1 000 = 24bit RGB through MVA (at 1x dot-clock frequency) 

9hs 1001 s 8 bit RGB through the palette 

For improved quality of 6 bit/pel. A program can even update the 
palene dunng 8bit live video to get more colors. 

ah= 1100 s 6 bit direa color grey shaded (RasGsBsSbit grey shade) 

To be used for immage processing in the pnnting industry related 
applications. This mode Nordic can run at 1024x768 as any other 
SbiVpel. 

Bh:Fh = 1001:1111 = reserved for future formats 

When a Motion Video Window is created data aiwqays goes through the MVA 
oata path. In this case amy the VGA Data Path can be used for the suroundmg 
aata. 

If no Motion Video Window, the MVA data path can be used to display full screen 
in any of the above formats. Especially for high pixel depth modes (24. 16bpp) it is 
recommended to use the MVA data path which runs at IX dot-clock frequency 
and has a larger FIFO than the VGA Oata Path. 

A full screen motion video window can be also defined that can be anywhere in 
memory and can run video or any application in the above formats. 



5.10 






CR3D- 
Blt 


Motion Video Window Horizontal Size Register 
Definition 
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MVA Oau Bub Signature Generation Selection bit 

0 « selects VGA Oata Path for signatire generation 

1 ■ selects MVA Oata Path for aignaturs generation 


CL 99809 



(6:0i 



Motion Video Wondow width in 8 pixel units 
This register is used to specify the horizontal width of the MVW in 8 dot-dock 
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' Nordic - Register Definitions 

units. 

The MVW has to be a multiple of 6 pixels. The value programmed in this register 
is used to terminate the MVW on each scan tine. 
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Cirrus Logic. Inc. Ei.^.neenng Specification 

— — 1— — Nordic - Register Definitions 
fixfl Registers for Pan^l ^ nrizontal TiminQ Control 

This set of four registers are used to generate horizontal panel timing with 640x460 or 800x600 
panels and to center horizontally a 640dot5 or 720dots picture on an 800x600 panel. 

6.1 CR40 - No Center Panel HDE Start Register 

Bit Definrtion 

[7:0] Panel Honzontai Display Enable Stan relative to previous HDE start, in 4 dot- 

dkock units. The dot-ctock used is never divided by two. This register is used to 
program Panel Line Clock Start and Panel Dispiay Enable Start with both 
640x400 and 800x600 panels any time no horizontal centering is needed. 
Used automatical! y by h/w if CR41 and CR42 are not used. 



6.2 CR41 . Panel HDE Start Register to Center 720 dote 
Bit Definition 

F-0] Pane) Honzontat Display Enable Start relative to previous HDE start, in 4 dot- 

clkock units. The dot-clock used is never divided by two. The value in this register 
will be automaticatiy used by Nordic to control Panel Line Clock and Panel Hori- 
zontal Display Enable Start anytime a 720 dot mode (text or graphics • RIX mode 
only) is centered on an 800x600 panel. If horizontal expansion is on. CR40 is 
used. 

Used automatically by h/w if : 

800x600 panel & No 800x600 graphics mode & 8 dot character clock & 
no honzontai expansion 



6.3 CR42 - Panel HDE Start Register to Center 640 dots 
Bit Definition 



[7:0; Panel Honzontai Display Enable Stan relative to previous HDE start, in 4 dot- 

dkock units. The dot-clock used is never divided by two. The value in this register 
will be automatically used by Nordic to control Panel Line Clock and Panel Hori- 
zontal Display Enable Stan anytime a 640 dot mode (text or graphics ) is centered 
on an 800x600 panel. If honzontai expansion is on. CR40 is used. 
Used automatically by h/w if : 

800x600 panel & No 800x600 graphics mode & (9 dot character clock ♦ horizontal 
display enable >« 50H ) 4 no expansion ^. ronnd^ti.l 

no honzontai expansion Jr^^^ Conndentitl 
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This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the appHcant. 

Defects in the images include but are not limited to the items checked: 

^ BLACK BORDERS 

1^ IMAGE CUT OFF AT TOP, BOTTOM OR SroES 
^ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

]Xj COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



